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FOREWORD 

In March, I960, The Board of Education of the Community- 
Consolidated School District No. 65, Cook County, Illinois, 
contracted with Educational Testing Service to conduct a study of 
the effects of school integration by redistricting and busing upon 
the pupils, teachers and parents of the City of Evanston. 

This report is a summary of activities completed on behalf 
of the Evanston Integration Study (subcontract, with Evanston 
District 65 from the Rockefeller Foundation), as well as a design 
projection through to conclusion of the study, June 30, 1971. 
Results of analyses undertaken to date are not included, but a 
tentative schedule for their transmission is provided. 

The activities which have been projected seem presently 
feasible within the budgetary limitations. Subsequent scheduled 
reviews of cost factors may lead to future revisions. 
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BACKGROUND 



A position paper on school integration studies concluded 
that "one good reason that there has been no adequate research on 
the effect of integration is that there have been no adequate real- 
life tests — no large scale, long-run instances of ethnic integra- 
tion in top-quality majority-white schools. . . ." Community 
Consolidated School District 65, Evanston-Skokie , Illinois, would 
seem to be a pioneer in its committment to a longitudinal study 
on the effects of desegregation in a recognized top-quality, 
majority-white school system. 

District 65 schools were desegregated in September, 1967, 
by combining redrawn school boundaries to limit de facto segrega- 
tion with the busing of some black pupils from central Evanston 
to the peripheral all-white schools. At that time the adminis- 
tration committed itself to initiate a long-term study to find 

out what impact desegregation had upon the pupils, the schools 

2 

and the community. Support for a proposed hhree-year study 
was funded by the Rockefeller Foundation in March, 1968. 
Subsequently, a contract was drawn with Educational Testing 
Service, which was to undertake a substantial part of the study 
in cooDeration with District 65 personnel. 



1. Nancy H. St. John, "Minority Group Performance Under Various 
Conditions of School Ethnic and Economic Integration," 

IRCD Bulletin U> May, 1968, p. 2. 

2. Gregory C. Coffin, "A Proposal for Evaluation of Integration 
of Evanston District 65 Schools," January, 1968, 21+ pp. 
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It is important to distinguisn the difference between the 
meaning of the terms desegregation and i ntegration . Desegregation 
of a school district means, at best, that physical proximity of 
black and white pupils has been brought about in balanced ratio. 
Desegregation can be achieved by administrative fiat, with or 
without broad based community support. 

Integration, on the other hand, goes beyond improving 
opportunities for unrestricted physical access to equality in 
education. Integration means the realization of equal educational 
opportunity and respect for individual differences based on a 
foundation of community support. Mutual respect, acceptance and 
cooperation characterize an integrated school community. 

The stated goal of the present study is to determine the 
outcomes of integration in District 65 schools by seeking answers 
to the following questions: 

1. What impact, if any, may desegregation have had upon 
achievement of white and black students? 

2. How may the attitudes of students have been affected 
by the integration program? 

3. How may attitudes of parents, teachers and other 
interested persons have been affected? 

In order to break down these three questions into small 
enough units so that specific hypotheses can be formulated and 
tested for each, a series of questions has been phrased within 
four broad behavioral categories which exert influence upon end 
which in turn reflect the process of integration: (l) the 

individual student, (2) his family, ( 3 ) his school and (/+) 
community factors. 
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The Student. 
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1. What was the status of central tendencies and var- 
iability of academic test scores of pupils grouped 
by race, sex and prior segregated school experience 
at the beginning of the study? Were any differences 
between groups significant statistically? 

2 . Would there be any differences in the direction and 
magnitude of change in aptitude and achievement test 
scores among groups on subsequent retests during the 
three years of the study? 

3 . Would differences which might arise in outcomes of 
achievement and aptitude testing be accompanied by 
changes in the grades earned by pupils before and 
after desegregation? Would there be subject dif- 
ferences? 

When prior test results from pupil records are 
compared to test results of the present study, would 
differences found in the integration evaluation 
testing program be confirmed? 

5. What was the initial status of pupil eelf-concept 
and attitude towards school among the groups studied? 

6. How would patterns of self-concept and attitude towards 
school change over the period of the integration study? 

7. Would there be evidence of changing friendship patterns 
in classrooms as a result of desegration? 

The Pupil and His School . 

1, Howteve busing and changing schools affected the 
attendance and academic performance of the students 
involved as reflected in school records? Do changes, 
if they are found, seem to be long-term or transient? 

2, Can observed group differences in attendance and 
academic performance be associated with the pre- 
desegregation racial composition of their former 
schools? 
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Some recent studies have indicated that the socio- 
economic level of a school -5 is related to ard may- 
inf luence pupil performance. Does the Evanston 
study bear out such influence? 

4, How has the attitude of teachers toward integration 
developed over the period of the study? 

5- When classrooms are studied as a unit, what changes 
are observed in the ability of different races to 
plan and carry out classroom activities as a cooper- 
ative group? 

The Pupil and His Family . 

1. What relationship has the socioeconomic status of 
the family to pupil achievement and aptitude as 
measured by tests, grades and observation? 

2. Are black and white parents comparable in their 
interest in school and educational aspirations for 
their children? Are they successful to the same 
degree in translating their interest into overt 
observable behavior such as attending conferences, 

FTA meetings? Can their interest be seen reflected 
in their children’s academic performance? 

Integration and the Community , 

1. Have specific community organizations publicly 
made known viewpoints on school integration issues? 

2. What was the expressed attitude of the black and white 
communities at the time decision for integration was 
made, and how have these attitudes changed during the 
following period of study? 

3. Has black participation in school-related organizations 
increased since the implementation of school desegre- 
gation? 

h. Have local news media followed the process of integra- 
tion and taken editorial stands on issues? 



3. R. Herriot and N. St. John, Social Class of the Urban School. 
New Yorki Wiley, 1966. 
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5. Has the city government made decisions and enacted 
laws in the climate oi' concern for human rights 
which initiated the decision to desegregate? 

Activities of the study through May, 1969 have reflected 
concern for the allocation of resources (time and money) avail- 
able to those undertakings which would produce the most valid 
answers to the questions which have been posed. Preliminary 
design, as outlined in the original proposal to the Rockefeller 
Foundation,^ has been pursued through initial data collection 
and processing. Also, as a consequence of the experiences which 
have been acquired to date, the initial design has been modified. 
Specifically, the proposed study has been strengthened by the 
addition of one more year of testing to its data base; restric- 
tions have been made in the range of data to be collected, and 
a more efficient schedule for data analysis has been developed. 
Some future modifications of design may arise in order to 
accommodate the available resources. 



4. Coffin, 22 - 



r 



8 



DESIGN AND PROCEDURES 



The Quasi -experimental Design 

In order to design a true experiment, it would be necess- 
ary to randomly assign pupils to experimental and control groups, 
desegregate the experimental subjects, and follow the progress of 
the two groups over the period of the study. 

In real life, however, it is unthinkable to seek niceties 
of methodology to the extent of sacrificing the need for human 
dignity. The design of the Evanston study falls into the 
classification of the quasi-experimental . ® This means that 
randomization wil] not usually have been achieved, but, whenever 
possible, 'before* and a series of T after* measures of perform- 
ance of various naturally occurring groups of pupils will be 
made to assess the impact of desegregation and the progress of 
integration. 

Academic achievement and aptitude were measured during 
September, 1967, which was the beginning of desegregation, and 
again one year later during September 1968. These tests will 
again be administered to selected groups during September, 1969, 
and September, 1970. Pre-desagregation self-report attitude 
questionnaires were administered by Dr. Campbell of Northwestern 
University and repeated in the spring of 1968 and 1969^ Other 



5. Donald T. Campbell and Julian C. Stanley, "Experimental and 
Quasi-Experimental Designs for Research on Teaching," Handbook 
of Research on Teaching , N. L. Gage, Editor. Chicago: Rand 

McNally and Company, 1963, pp. 171-2A6. 

ERJC 
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performance and observational measures of self-concept, attitude 
to school and cooperativeness in school are included in the design 
to determine whether professed attitudes are reflected by appropri- 
ate behaviors. 

Some design features call for the collection of descriptive 
data by which to further classify pupils and thus increase design 
sensitivity. Evanston, unlike other suburban Chicago North Shore 
communities, is a city of considerable diversity in terms of 
socioeconomic levels, ethnic composition of residents, and 
neighborhood housing patterns. Until desegregation was implemented 
in 1967, some pupils attended segregated schools, whether all 
black or all white, while others were in schools of varying racial 
proportions. The design for the study calls for opportunistic 
exploitation of these naturally occuring groups in order to tease 
out the separate effects of prior school experience, busing, 
family background, and academic aptitude upon the achievement and 
attitudes of District 65 pupils. Advanced computer-assisted, 
statistical procedures can then subsequently be applied to most 
of the other data which will have been collected. 

Fortunately, unlike many urban schools where student 
attrition is highly destructive to research plans, Evanston has 
been a relatively stable community. Cumulative school records 
are available for many pupils fr^m kindergarten on. Thus, in 
addition to new data gathered specifically for the present study, 
there is a rich pool of historical information with which to add depth 
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to the profiles of the students. 

Assessment of teachers and more especially parents 1 attitudes 
poses more serious problems of methodology and ethics. The answers 
to controversial questions gathered via paper and pencil tests 
cannot always be taken at face value. Many people, with justifica- 
tion, resent being considered guinea pigs and resist with vigor 
any invasion of their privacy. Consequently, it has been decided 
that as many unobtrusive measures of attitude, imaginatively 
described by Webb et, al.,^ will be used as possible. Simple and 
contrived observations' and public records are being sought to 
supplement any verbal information found via questionnaire or 
interview methods. 

Pupil Population 

The actual and projected enrollment of pupils in District 
65 over the interval of the study are recorded in Table I (see p. 9). 

Tests of academic skills were given on a district-wide basis 
in September, 1967, and September, 1968. These tests will be 
readministered according to the schedules summarized in 
Appendix A, Figures 1-4. At present, testings are projected only 
for grades 1, 3, 4 , 6 and 7 in September, 1969; and grades 1, 3, 



6. Eugene J. Webb, Donald T. Campbell et al. Unobtrusive Measures; 
Nonreactive Research in the Social Sciences . Chicago; Rand 
McNally & Company, 1966, 185 pp. 

7. Ibid . 
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Table I 





Enrollments in Grades 
fxom_1967_-68 iActual) 


K-8 of Evanston 
through 1970-71 


District 65 
(Predicted) 




Grade 


1967-68 


1968-69 


1969-70 


1970-71 


K 


1364 


1439 


1424 


1407 


1 


1223 


1259 


1328 


1314 


2 


11S9 


1185 


1220 


1287 


3 


1207 


1183 


1179 


1214 


4 


1172 


1203 


1179 


1175 


5 


1148 


1164 


1195 


1171 


6 


117c 


1158 


1174 


1206 


7 


1107 


1207 


1187 


1203 


8 


1224 


1111 


1212 


1192 


Total 


10,812 


10,909 


11.098 


11,169 



f 
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4, 7 and 8 in September, 1970. 

Another design facet has called for random selection of one 
quarter of the white pupils and the entire black pupil population 
to be included in the sampling frame for a detailed study of the 
separate effects of prior school experience, busing, previous test 
results, family and neighborhood influences, and other non- 
academic variables. 

Classrooms in which observations of teacher and pupil are 
to be made are selected on random basis. Once classes are selec- 
ted, repeated systematic observations are arranged to assess the 
reliability of observers and instruments. 

An attitude questionnaire for pupils was administered to 
fifth graders in four schools before desegregation. It was 
repeated on a larger sample after one and two academic years of 
desegregation. A questionnaire for teachers was given to all 
teachers of the 1968 Summer Institute. It will be repeated on 
random samples of non-participant teachers during the next two 
years. 

A randomly selected sample of fifth grade parents was 
interviewed in connection with a child-rearing practices study 
under the auspices of the Institute of Juvenile Research. These 
data will be made available for the present study. 

Figures 1-/+ are also schematic diagrams of the longitudinal 
design for those pupils, black as well as white, who had experi- . 
ced dc fact segregation prior to the implementation of 
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desegregation by busing. In addition to the pupils who were 
in segregated schools before 1967, other District 65 pupils 
experienced varying racial proportions in their schools. 

The pupils can be divided into the following groups according 
to their experience prior to as well as their treatment since 
fall, 1967: 

1. Foster School pupils who are now being bused (N - 208). 

2. Dewey School pupils who are now being bused (N = 145). 

3. Foster School pupils who are not bused (N = 444). 

4. Other black pupils who are not bused (N = 1,546). 

5* White pupils whose schools were de facto segregated. 

6. White pupils who attended integrated schools. 

During the period of the study, new admissions, black and 
a proportion of the whites, will be studied as separate groups 
to determine the mutual impact of District 65 on newcomers. 

Measures 

A schematic presentation of the measures to be used to 
test the hypotheses of the study, the schedule of activities, 
and the subjects to bo tested, is shown in Table II (sea pp. 12-14). 
The measures were chosen on the basis of being appropriate to 
answer the questions posed as hypotheses. 
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Table II 

A Schedule of Measures and Activities for Evan ston Integration Study 
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Table II Continued 
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Systems Design and Maintenance 

The data file maintained at ETS for the District 65 study 
should fulfill three requirements: 

1. The data should be as complete as possible. 

2. The data should be virtually error-free. 

3. The data should be readily accessible. 

Codings for the volume of information to be obtained through 
testing, observation, questionnaire and archives; and planning 
of appropriate sequential card layouts have been completed. 
Achievement ana aptitude tests scores from Fall 1967 and 1968 
have been transferred to tape; pupil record information has also 
been coded, punched and taped. 

PERT networks were originally developed for most phases of 
the project. Those networks are expanded and updated as needed. 
Frequent cost analyses accompany applications of FERT to the study. 

DATA ANALYSIS 

Fundamental Technical Issues 

No single analysis of the data collected from a comprehensive 
longitudinal program, such as the Evanston integration study, 
would yield answers to all the questions being posed. This cir- 
cumstance arises in part from the great volume of data which exist 
across the several areas of concern in the study. It also arises 
because of fundamental difficulties inherent to quasi -experimental 
designs of the type which constitute the major part of the study. 
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A difficult and fundamental problem exists when groups 
of students are classified as being in a certain grade in a 
certain year and as comprising a certain "class. 11 The word 
"class" is used here in the sense that a class goes through the 
educational process together, as in the high school and college 
expression, "class of 196?." 

The problem starts with the fact that for any given school 
system, the specification of all three of grade, year and class 
is redundant. One needs only two of these three to identify 
a set of test scores obtained by a group of students. This issue 
can be understood by considering grade (horizontal), year 
(vertical) and class (diagonal) vectors to be associated with an 
outline of a table in which to record test score data or summary 
statistics derived from that data. Such an outline could, for 
this study, take a form: 

Grade 

Year U 5 

1967-68 

1968-69 

Within the body of the table would then be recorded the grade, 

> 



year and class vectors: 



Grade 
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One can perform an analysis of variance with recorded test 
scores by classifying the data by levels of two of the factors, 
if it is safe to assume that there is no significant variation 
due to the third. For example, an analysis of variance could 
be performed with year and grade as classifications if students 
do not differ across classes, i.e., that the District 65 "class 
of 1972", who were fourth grade pupils in 1967-6& is no different 
from the classes of 1971 or 1973. Might it be similar in size 
and importance to differences in achievement outcomes to be 
expected from desegregation? Is a between class difference 
such as this of no importance? 

The analysis of variance suggested in the preceding paragraph 
and the issues associated with its use both serve to illustrate a 
fundamental problem to be dealt with in data analysis, and to 
introduce the importance of providing for both cross-sectional 
and longitudinal analysis options. A second approach is to include 
only one level for one of the grade, year or class factors. But 
that common practice leaves the effects of the other two factors 
confounded and indistinguishable. That approach is taken in 
cross-sectional and longitudinal studies. Cross-sectional studies 
(done with a single year effect) typically attribute variations to 
grades and ignore class variation; longitudinal studies (following 
a single class) typically attribute variation to grades, ignoring 
variation due to years. 
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A third approach can be to compare the group being studied 
with some other (control) group for which one is willing to 
assume that one or two of the effects contribute negligible 
variation. The only potentially useful control groups which 
seem to be' accessible are the groups tested to develop normative 
groups for academic skills measures. The resolution of what may 
be the most formidable issue in this study depends on assessment 
of variation due to year effect. If it may be assumed that the 
year effect in normative groups has been negligible* which may 
be possible for at least the SCAT-STEP tests, then that issue 
can be handled by scheduling a variety of cross-sectional and 
longitudinal analyses each of which has been selected for its 
pertinence to specific hypotheses and questions of concern in 
the study. All planring for data analysis has been undertaken 
under the belief that only by carefully attending to the com- 
{iexities of the confounding of grade, year and class through 
the use of multiple analyses could a credible summation of de- 
segregation outcomes be presented. 

Future data collection, which must be planned with simul- 
taneous concern for the technical issues which exist, has taken 
into consideration several additional priority relationships. 
Among them are: 

1. The analyses planned and the relative 
importance of them. 

2. The relative difficulty of testing at 
the various grade levels. 
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3. The desirability of having a variety 
of tests and grade levels. 

4 . The relative values of the information 
to be obtained, based on 

a. amount of information (how many 
scores of what discrimination 
quality) 

b. uniqueness of information vis-a- 
vis other studies of desegregation 

c. comparability of information with 
that of other studies. 

The sections which follow in this chapter therefore outline the 
multiple modes of analysis which are projected for use with the 
data now scheduled for collection. 

Preparation of Data for Analysis 

The second district-wide testing of academic areas was completed 
on schedule. The data available so far include aptitude and achieve- 
ment scores for all pupils in September, 1967 and again in September, 
1968. In addition, during the summer of 1968, considerable personal 
information was amassed by the application of sampling frames to the 
files of pupil cumulative folders. These latter include coded data 
on grades in all subjects received prior to and since desegregation, 
birth place, mobility, parents' birth place, occupation and marital 
status, number of siblings, position in family and home language. 

A large volume of scores on standardized achievement and intelli- 
gence tests which had been accumulated by District 65 prior to 
1967 was available for many subjects in the sampling frame and was 
coded for keypunch. 
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Prior to actual data analysis it is necessary to assemble it 
into packages which are as complete and accurate as possible. 

During the first year of the study data forms were frequently ac- 
quired which had many omissions and errors in them. The presence 
of these errors and omissions have necessitated considerable addi- 
tional effort to correct and secure information which was essential 
to the conduct of a valid investigation. Almost all available 
data has been transferred to tape to ready it f^r subsequent 
analyses . 



Analyses Through April, 19^9 

Distribution analysis programs have been written for this 
study. They were written to provide frequency distributions and 
key statistics on groups of students with the same sex, race, 
grade and school for a given test in a given year. It also 
pro' \des the same data aggregated across sex, race and both sex 
and race. Then, it provides the same data aggregated across schools 
for a view of the entire school district. It is tabulated in such 
a way as to make visual inspection and comparison of groups particu- 
larly easy. Skewed, bimodal and flat-topped distributions and 
outliers are made apparent. 

The processing of academic skills data has been initiated 
through use of the programs which were written. Outputs of those 
analyses have been subjjiitted to visual inspection; a variety of 
tables and figures have been prepared from the output. Distribution 
analyses are continuing ct the time of this writing,as is the study 
of the contents of computer output sheets. 
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Projected Analyses 
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Distribution analyses are projected to be run soon after 
September/ 1969 and September, 1970 testings. Outputs will be 
directly comparable to those for the two preceding testings. 

In addition to the information gained from the distributive 
analyses, more knowledge about the following aspects of pupil 
performance will be sought: 

1. Information about gains made by 
individual pupils over time, 

2. Comparisons of groups of pupils 
in terms of sex, race, grade, 
years of prior segregated schooling 
and the like, and 

3* Some assessment of the actual dif- 
ferences between schools in terms 
of educational performance when 
input variables are controlled. 

The major categories of pupil data will be available which 
include (1) cross-sectional comparison data, (2) matched longi- 
tudinal data having individual student scores as units. (3) matched 
longitudinal data having school means for pupil groups as units- 
(4) mobility data for estimating characteristics of pupils entering 
and leaving District 65, and (5) cumulative record data including 
grades earned, SES information and teacher comments on attitude 
and study habits. 

In a study such as this, it is tempting to consider exhaustive 
analyses of each package of data (for example, that of each yeav) 
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as it becomes available. However, with the exception of distri- 
bution analyses, such efforts will be avoided in order to conserve 
financial and personnel resources* Strong preference is being 
given for more inclusive and comprehensive forms of analysis 
whenever possible. 

To facilitate internal and external communications with regard 
to analysis, hypotheses have been formulated, to which modes of 
analysis may be directly related. These hypotheses can, in turn, 
be related to the questions phrased in the earlier chapters on 
background and design. By referring back to Appendix A v'hile 
studying the hypotheses and accompanying comments about analysis, 
the reader may acquire an understanding of the sources of data 
which will be called for in each analysis, the pertinence of the 
hypotheses to technical design considerations, testing schedules, 
and other issues. 

Some hypotheses call for the use jf cross-sectional data . 

They are H^s 1, 2 and 3 which, in accompaniment with remarks 
about their analysis, follow. 

H q 1: Among pupils wh-> entered District 65 
as Kindergartners in T 6? ana T oB and 
first graders during Fall 1 6? , ’63 
and f 69; there were no differences 
in test performance when they were grouped 
according to race and sex. 

Analyses: Analysis of variance of Caldwell scores 
or STEP Listening, or P statistic. 



H 2: 
0 
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There were no differences among groups in 
test performance over three years for third, 
fourth and seventh graders . 


Analyses : 


ANOVA of Coop Scores (Grades 3* 4 and 7) and 
STEP-SCAT scores: grades (2) by race (2) by 

sex (2) by segregated schooling (2). Other 
options include t or p-statistics and multiple 
discriminant functions. 


H o 3 '- 


There were no differences among groups 
classified by race, sex and prior segregation 
in terms of mean gains over three years when 
cross-sectional gain in scores from grades 4 
to grades 7 were analyzed. Some sort of 
standard unit such as mean gain /SD or gain/ 
standard error of measurement could be used 
for comparison purposes, 


Analyses : 


P statistic, univariate ANOVA of groups and 
discriminant function analyses are options. 
Also, the residual gain - i.e., that portion 
of the grade scores for each group which is 
not correlated with 4th grade performance. 



Five hypotheses are to be considered which call for 
longitud inal data analysis. 



H o 4 f ! There were no differences in gain 1 67— 1 68 
and '68-' 69 of Caldwell Preschool and STEP 
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Listening among groups of kindergarteners 
who entered District 65 in Fall, 1967, when 



Analyses : 


initial ability was accounted for. 

ANOVA of residual gains when either Caldwell 
scores or Caldwell plus SES are used as 
covariates, or multiple regression analyses 
using Caldwell, father's occupation and 
home address as well as race as independent 
variables and gain as dependent variables. 


V s 


For the same pupils, the gain in STEP 
scores other than Listening in grades 2 
to 3 during 1 6S-'69 were not different among 
groups. Caldwell scores may be used as 
covariates , 


H o 6: 


There were no differences in gains over years 
of STEP-SCAT scores among groups of Fal] , 1967, 
fourth graders when initial ability was 
accounted for. 


Analyses: 


ANOVA of residual gains or discriminant 
function . 


H o 7: 


Same as above, but for fifth graders. 



Hypotheses may also be specified which call for analysis of 
data between school s . 

H q B: Other things being equal, there were no 



differences among schools in pupil gains 
between grades 1 and 3 among groups. 



Analyses : 


Predicting third grade scores solely from 
first grade scores, to obtain an expected 
output and then correlating school with 
residual, or discriminant function. If 
within school slopes are examined, of output 
on input measures, the relative offective- 
ness for superior and inferior students 
might be inferred. 


H o 9: 


Same as above, but for grades 4-6 gains. 


H 10: 

0 


Same as above, but for grades 6-8 gains 
within junior high schools. 



Finally, analyses may also be related to specific hypotheses 
requiring other data . Three such hypotheses are most important. 



H 11: 
0 


For fourth graders in 1967, their school 
grades earned had no systematic relation- 
ship to achievement or aptitude test scores. 


Analyses : 


Multiple correlation or canonical correlation. 


H 12: 

0 


Pupil’s SES as well as race contribute 
significant variance to grades earned in 
addition to that of ability. 


Analyses : 


Multiple regression, Analysis of covariance 
or multiple discriminant functions. 


H 13: 
0 


Teacher’s perception of pupil behavior has 
no relationship to grades, test scores, race 
or SES of pupils. 



__ 7b. 

Analyses: Discriminant functions, multiple regression 

or AN OVA. 

Statistical References 

Ore of the statistical procedures which was referred to 

in the preceding section has not, as have the others, been used 

extensively. It may have, however, some advantages which 

support its use at this time. The p-measure is a measure of 

the difference between two probability distributions. If one 

takes two sets of numbers (scores), (x^, x^, . . .x^) and 

(yi, y^, . . . y n )j then the probability that a randomly selected 

x is larger than a randomly selected y is the p-measure of the 

x . ' s with respect to the y.'s. P is the Wilcoxen-Mann Whitney 
* J 

statistic, divided by the product of the sample sizes, inn. 

g 

One of the early discussions of p was by Birnbaum in 
1956. The power-efficiency of the Mann Whitney test is about 
95% of that of the t-test when used in lieu of the t-test. 

But, with the p-measure, one has the advantage that the assump- 
tions of normality and equal variances are not needed. 

Analysis of variance and other statistical procedures 
which have been referred to are described in a wide variety of 



8. Z. W. Birnbaum, "On a Use of the Mann-Whitney Statistic", 
Proceedln&sL of the Third Berkeley Symposium on Mathematical 
Statistics and Probability , Vol. 1 (University of California 
Press, ^956), pp. 13-17. 
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sources among which are Winer, Tatsuoka and Tiedman, and 

Rao.^ Applications of those methods which have relevance to 

12 

this study have been discussed by Dyer and Linn , Manning and 
Dubois,^ Shaycroft,^ and Werts and Linn^. 

More than one statistical procedure is being planned 
for each hypothesis to reduce equivocal results in final output. 
Between the current date and time when final analyses 
must be run it is likely that additional options for analysis 
will arise. Budgetary restrictions will influence the selection 
of final combinations of analyses to be undertaken. 



9. B. J. Winer, Statistical Principles in Experimental Design . 

New York: McGraw-Hill Book Company, 1962, 672 pp. 

10. Maurice M. Tatsuoka and David V, Tiedeman, T, Statistics as 
an Aspect of Scientific Method in Research on Teaching, 1 ' 
Handbook of Research on Teaching . N. L* Gage, Ed., Chicago: 
Rand McNally and Company, 1963, pp. 142-170, 

11. C. R. Rao, Advanced Statistical Methods in Biometric Research , 
Wiley, 1962. 

12. Dyer and Lirn, "Methods of Measuring School System Performance" 
RB-68-55 . 

13. Manning and Dubois, "Gains in Proficiency as a Criterion in 
Test Validation 11 , Journal of Applied Psychology , 42, 195&, 
pp. 191-194- 

14. Shaycroft, Marian, "The High School Years - Growth in 
Cognitive Skills", AIR, 1967. 



15. Werts and Linn, "Analyzing School Effects", RB-68-60. 



REPORTING AND DISSEMINATION 



The flow of acadendc skills data generated by the 
Evanston Integration Study permits the ETS project staff to 
prepare statistical summaries containing purely descriptive 
information as it becomes available. Distribution analyses have 
been scheduled for that purpose with outputs suitable to 
plotting and reporting in a variety of formats. A copy of each 
validated distribution analysis output will be transmitted to 
District 65 as it becomes available. ETS personnel will review 
outputs of the distribution analysis program, and prepare summaries 
of their contents for internal project-associated scrutiny, as 
well as for transmission to District 65. Additional transmissions 
will be made during the Summer of 1969, after Fall, 1969, and 
Fall, 1970 testings. 

Final multivariate analyses will be scheduled for Fall 
and Winter of 1970-71. Outputs of these more complex analyses 
will also be studied, summarized and transmitted to District 65 
as they become available, with a final summary document scheduled 
for preparation during Spring, 1971. 

It is doubtful that any appreciable dissemination efforts 
should be made prior to the conclusion of the study in June, 1971. 
Certainly, no evidence that the academic performance of white 
students has been harmed or that the academic performance of 
black children has been ippreciably improved as a result of 
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desegregation has come to the attention of project staff 
at this time. But this does not mean that the possibility of 
such outcomes, however unlikely, may not later be entertained, 
when data has been more comprehensively studied. Therefore, 
a full scale summary for transmission to District 65 , which 
holds responsibility for dissemination, will not be available 
until June, 1971. Earlier brief, qualified, descriptive 
summaries cam then be augmented and corrected by a general 
press release. 
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BUDGET AND EXPENDITURES 
March 18, 196 S through May 31, 1969 

Expenditures through May 31, 1969 and projected 
expenditures for later intervals of the study are recorded in 
Table III on the following page. The actual expenditures to 
date are a considerable proportion of the total ETS budget of 
$107,000.00 because they cover more than half of all projected 
costs for testing of academic skills and the very heavy 
financial burdens associated with initiating the data storage 
and analysis procedures. Data cards have been converted to 
tape, schedules for later data collection developed, and 
technical questions of design have been studied. A reduction 
can be noted over the remainder of 1969 and the first half of 
1970; expenditures for analysis and report writing will contribute 
to increased costs over the final fiscal year. 
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Actual and Estimated Costs for ETS Subcontract to District 65 
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District 65 Aptitude and Achievement Testing Sched^es 
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Figure 1 



Caldwell Prenchool Inventory 



District 65 Aptitude and Achievement Testing Schedule* 



Time 



Pupil Grade 



Sept. 1967 



Sept. 1968 




X, 



Sept. 1969 



X 0 x, 



x 3 x 4 



Sept. 1970 



X 0 X 0 



x 3 x 4 



Subscripts denote years of segregated schooling 
Matched Longitudinal Gains Analysis. 

Cross-sectional Comparisons. 
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Figure 2 



Cooperative Listening Test 



District 65 Aptitude and Achievement Testing Schedule* 



Time 



Pupil Grade 



K1234567S 



Sept. 1968 X Q X 2 



Sept. 1969 



Sept. 1970 




X 4 X 5 X 6 



X 3 \ 



X 0 X 0 



X 3 X 4 



* Subscripts denote years of segregated schooling. 

— > Matched Longitudinal Gains Analysis. 

- - - Cross-sectional Comparisons. 
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Figure 3 



Cooperative Reading, Word Analysis, Writing and Mathematics 



District 65 Aptitude and Achievement Testing Schedule^ 



Pupil Grade 

Time K 1 2 3 4 5 6 7 3 



Sept. 1967 X Q X Q 



Sept. 1968 X Q X Q 



Sept. 1969 X Q 




x 3 x 4 x 5 x 6 



X 3 X 4 



Sept. 1970 



X 



4 



O 

ERIC 



Subscripts denote years of segregared schooling. 
Matched Longitudinal Gains Analysis. 
Cross-sectional Comparisons. 
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Figure b 



SCAT STEP 



District 65 Aptitude and Achievement Testing Schedule-- 



j 

i 

t 



Time 

Sept. 196? 



Sept. 196? 



Sept . 1969 



Sept. 1970 



Pupil Grade 

K12345678 




# Subscripts denote years of segregated schooling. 

> Matched Longitudinal Gains Analysis. 

- - - Cross-sectional Comparisons, 
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